Functional Organization of Social Perception and Cognition in the Superior Temporal Sulcus

The superior temporal sulcus (STS) is considered a hub for social perception and cognition, including the perception of faces and human motion, as well as understanding others' actions, mental states, and language. However, the functional organization of the STS remains debated: Is this broad region composed of multiple functionally distinct modules, each specialized for a different process, or are STS subregions multifunctional, contributing to multiple processes? Is the STS spatially organized, and if so, what are the dominant features of this organization? We address these questions by measuring STS responses to a range of social and linguistic stimuli in the same set of human participants, using fMRI. We find a number of STS subregions that respond selectively to certain types of social input, organized along a posterior-to-anterior axis. We also identify regions of overlapping response to multiple contrasts, including regions responsive to both language and theory of mind, faces and voices, and faces and biological motion. Thus, the human STS contains both relatively domain-specific areas, and regions that respond to multiple types of social information.David & Lucile Packard FoundationNational Science Foundation (U.S.). Graduate Research FellowshipNational Science Foundation (U.S.) (CCF-1231216

Unimpaired Attentional Disengagement and Social Orienting in Children With Autism

Visual attention is often hypothesized to play a causal role in the development of autism spectrum disorder (ASD). Because attention shapes perception, learning, and social interaction, early deficits in attention could substantially affect the development of other perceptual and cognitive abilities. Here we test two key attentional phenomena thought to be disrupted in autism: attentional disengagement and social orienting. We find in a free-viewing paradigm that both phenomena are present in high-functioning children with ASD (n = 44, ages 5–12 years) and are identical in magnitude to those in age- and IQ-matched typical children (n = 40). Although these attentional processes may malfunction in other circumstances, our data indicate that high-functioning children with ASD do not suffer from across-the-board disruptions of either attentional disengagement or social orienting. Combined with mounting evidence that other attentional abilities are largely intact, it seems increasingly unlikely that disruptions of core attentional abilities lie at the root of ASD.Ellison Medical FoundationMassachusetts Institute of Technology. Simons Center for the Social BrainEunice Kennedy Shriver National Institute of Child Health and Human Development (U.S.) (Award F32-HD075427

Using child-friendly movie stimuli to study the development of face, place, and object regions from age 3 to 12 years

Scanning young children while they watch short, engaging, commercially‐produced movies has emerged as a promising approach for increasing data retention and quality. Movie stimuli also evoke a richer variety of cognitive processes than traditional experiments, allowing the study of multiple aspects of brain development simultaneously. However, because these stimuli are uncontrolled, it is unclear how effectively distinct profiles of brain activity can be distinguished from the resulting data. Here we develop an approach for identifying multiple distinct subject‐specific Regions of Interest (ssROIs) using fMRI data collected during movie‐viewing. We focused on the test case of higher‐level visual regions selective for faces, scenes, and objects. Adults (N = 13) were scanned while viewing a 5.6‐min child‐friendly movie, as well as a traditional localizer experiment with blocks of faces, scenes, and objects. We found that just 2.7 min of movie data could identify subject‐specific face, scene, and object regions. While successful, movie‐defined ssROIS still showed weaker domain selectivity than traditional ssROIs. Having validated our approach in adults, we then used the same methods on movie data collected from 3 to 12‐year‐old children (N = 122). Movie response timecourses in 3‐year‐old children's face, scene, and object regions were already significantly and specifically predicted by timecourses from the corresponding regions in adults. We also found evidence of continued developmental change, particularly in the face‐selective posterior superior temporal sulcus. Taken together, our results reveal both early maturity and functional change in face, scene, and object regions, and more broadly highlight the promise of short, child‐friendly movies for developmental cognitive neuroscience

Faces capture attention: Evidence from Inhibition-of-return

The human face is a visual pattern of great social and biological importance. While previous studies have shown that attention may be preferentially directed and engaged longer by faces, the current study presents a new methodology to test the notion that faces can capture attention. The present study uses the occurrence of inhibition of return (IOR) as a diagnostic tool to determine the allocation of attention in visual space. Because previous research suggested that IOR at a location in space only occurs after attention has been reflexively moved to that location, the current finding of IOR at the location of the face provides converging support for the claim that faces do have the ability to summon attention. Faces capture attention: The human face constitutes one of the most important stimuli for social interactions. In addition, face perception is considered to be the most developed visual perceptual skill in humans. Research using single cell recording (Perrett, Hietanen, Oram, ..

Fast Optimal Transport Averaging of Neuroimaging Data

Knowing how the Human brain is anatomically and functionally organized at the level of a group of healthy individuals or patients is the primary goal of neuroimaging research. Yet computing an average of brain imaging data defined over a voxel grid or a triangulation remains a challenge. Data are large, the geometry of the brain is complex and the between subjects variability leads to spatially or temporally non-overlapping effects of interest. To address the problem of variability, data are commonly smoothed before group linear averaging. In this work we build on ideas originally introduced by Kantorovich to propose a new algorithm that can average efficiently non-normalized data defined over arbitrary discrete domains using transportation metrics. We show how Kantorovich means can be linked to Wasserstein barycenters in order to take advantage of an entropic smoothing approach. It leads to a smooth convex optimization problem and an algorithm with strong convergence guarantees. We illustrate the versatility of this tool and its empirical behavior on functional neuroimaging data, functional MRI and magnetoencephalography (MEG) source estimates, defined on voxel grids and triangulations of the folded cortical surface.Comment: Information Processing in Medical Imaging (IPMI), Jun 2015, Isle of Skye, United Kingdom. Springer, 201

Response patterns in the developing social brain are organized by social and emotion features and disrupted in children diagnosed with autism spectrum disorder

© 2019 Elsevier Ltd Adults and children recruit a specific network of brain regions when engaged in “Theory of Mind” (ToM) reasoning. Recently, fMRI studies of adults have used multivariate analyses to provide a deeper characterization of responses in these regions. These analyses characterize representational distinctions within the social domain, rather than comparing responses across preferred (social) and non-preferred stimuli. Here, we conducted opportunistic multivariate analyses in two previously collected datasets (Experiment 1: n = 20 5–11 year old children and n = 37 adults; Experiment 2: n = 76 neurotypical and n = 29 5–12 year old children diagnosed with Autism Spectrum Disorder (ASD)) in order to characterize the structure of representations in the developing social brain, and in order to discover if this structure is disrupted in ASD. Children listened to stories that described characters' mental states (Mental), non-mentalistic social information (Social), and causal events in the environment (Physical), while undergoing fMRI. We measured the extent to which neural responses in ToM brain regions were organized according to two ToM-relevant models: 1) a condition model, which reflected the experimenter-generated condition labels, and 2) a data-driven emotion model, which organized stimuli according to their emotion content. We additionally constructed two control models based on linguistic and narrative features of the stories. In both experiments, the two ToM-relevant models outperformed the control models. The fit of the condition model increased with age in neurotypical children. Moreover, the fit of the condition model to neural response patterns was reduced in the RTPJ in children diagnosed with ASD. These results provide a first glimpse into the conceptual structure of information in ToM brain regions in childhood, and suggest that there are real, stable features that predict responses in these regions in children. Multivariate analyses are a promising approach for sensitively measuring conceptual and neural developmental change and individual differences in ToM.NSF (Award 1122374

Behavioral states may be associated with distinct spatial patterns in electrocorticogram

To determine if behavioral states are associated with unique spatial electrocorticographic (ECoG) patterns, we obtained recordings with a microgrid electrode array applied to the cortical surface of a human subject. The array was constructed with the intent of extracting maximal spatial information by optimizing interelectrode distances. A 34-year-old patient with intractable epilepsy underwent intracranial ECoG monitoring after standard methods failed to reveal localization of seizures. During the 8-day period of invasive recording, in addition to standard clinical electrodes a square 1 × 1 cm microgrid array with 64 electrodes (1.25 mm separation) was placed on the right inferior temporal gyrus. Careful review of video recordings identified four extended naturalistic behaviors: reading, conversing on the telephone, looking at photographs, and face-to-face interactions. ECoG activity recorded with the microgrid that corresponded to these behaviors was collected and ECoG spatial patterns were analyzed. During periods of ECoG selected for analysis, no electrographic seizures or epileptiform patterns were present. Moments of maximal spatial variance are shown to cluster by behavior. Comparisons between conditions using a permutation test reveal significantly different spatial patterns for each behavior. We conclude that ECoG recordings obtained on the cortical surface with optimal high spatial frequency resolution reveal distinct local spatial patterns that reflect different behavioral states, and we predict that similar patterns will be found in many if not most cortical areas on which a microgrid is placed

Infant cortex responds to other humans from shortly after birth

A significant feature of the adult human brain is its ability to selectively process information about conspecifics. Much debate has centred on whether this specialization is primarily a result of phylogenetic adaptation, or whether the brain acquires expertise in processing social stimuli as a result of its being born into an intensely social environment. Here we study the haemodynamic response in cortical areas of newborns (1–5 days old) while they passively viewed dynamic human or mechanical action videos. We observed activation selective to a dynamic face stimulus over bilateral posterior temporal cortex, but no activation in response to a moving human arm. This selective activation to the social stimulus correlated with age in hours over the first few days post partum. Thus, even very limited experience of face-to-face interaction with other humans may be sufficient to elicit social stimulus activation of relevant cortical regions

Negative Priming Under Rapid Serial Visual Presentation

Negative priming (NP) was examined under a new paradigm wherein a target and distractors were temporally separated using rapid serial visual presentation (RSVP). The results from the two experiments revealed that (a) NP was robust under RSVP, such that the responses to a target were slower when the target served as a distractor in a previous trial than when it did not; (b) NP was found regardless of whether the distractors appeared before or after the targets; and (c) NP was stronger when the distractor was more distinctive. These findings are generally similar to those on NP in the spatial search task. The implications for the processes causing NP under RSVP are discussed in the current paper

Does Sleep Really Influence Face Recognition Memory?

Mounting evidence implicates sleep in the consolidation of various kinds of memories. We investigated the effect of sleep on memory for face identity, a declarative form of memory that is indispensable for nearly all social interaction. In the acquisition phase, observers viewed faces that they were required to remember over a variable retention period (0–36 hours). In the test phase, observers viewed intermixed old and new faces and judged seeing each before. Participants were classified according to acquisition and test times into seven groups. Memory strength (d′) and response bias (c) were evaluated. Substantial time spent awake (12 hours or more) during the retention period impaired face recognition memory evaluated at test, whereas sleep per se during the retention period did little to enhance the memory. Wakefulness during retention also led to a tightening of the decision criterion. Our findings suggest that sleep passively and transiently shelters face recognition memory from waking interference (exposure) but does not actively aid in its long-term consolidation